^A062840 


lEva^^ 

mts  OtXXMKIt » MSY 

mt  OOPY  FURNISHEID  TO  DDC  OOWTAiMHb  A 
KtmTtCAVT  HUMBER  OF  PAGES  WHICH  DO  HO* 
HBPRODUCE  LEGTBtY. 


INTERESTINGNESS;  CONTROLLING  INFERENCES 
Research  Report  #145 


by  Roger  C.  Schank 
October  1978 


D D C 


|ii3Ziina 

DISTRIBUTION  STATEMENT  A 

u 

) JAN  4 1979 

Appioved  for  public  release; 

1 

Distributiorr  Unlimited 

ill 

jEMsinrEl 

YALE  UNIVERSITY 

DEPARTMENT  OF  COMPUTER  SCIENCE 


1 2 28  021 


DISCLAIMER  NOTICE 


THIS  DOCUMENT  IS  BEST  QUALITY 
PRACTICABLE.  THE  COPY  FURNISHED 
TO  DDC  CONTAINED  A SIGNIFICANT 
NUMBER  OF  PAGES  WHICH  DO  NOT 
REPRODUCE  LEGIBLY. 


INTERESTINGNESS : CONTROLLING  INFERENCES 


by 


Roger  C.  Schenk 
Yale  University 
Department  of  Computer  Science 
New  Haven,  Conn.  06520 


The  research  described  here  was  done  at  the  Yale  Artificial  Intelligence  Project 
and  Is  funded  In  part  by  the  Advanced  Research  Projects  Agency  of  the  Department 
of  Defense  and  monitored  under  the  Office  of  Naval  Research  under  contract  N00014 
75-C-llll. 


DISTRIBUTION  STATEMENT  A 

Approved  for  public  release; 
Distribution  Unlimited 


(KCUNITY  CLMMriCATlOM  OF  THIS  FAOl 


S$<riCATlON  OF  TMIS  FAOe  rwk*n  Om*  Bttlmnd) 


REPORT  DOCUMENTATION  PAGE 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


ICMT'*  CATALOS  NUMIIA 


InteresClngness:  Controlling  lnfcr«nces  * 


^ T.  AUTHOAf«;  

, Rc^er  C.  Xchanki 


1 Fcmoo  COVCRCO 

Technical 

•■  FKRFORMINO  ONO.  NSFONT  NUMSIR 

4-  UHfkktT  OR  dniNT  NUMSiNf*; 

, / 

Nrf|^4-75-C-llll  ^ 

10.  RRQORAM  ■LtMtNr.  RROJCCV,  TAM 
ARtA  0 WORK  UNIT  NUMWtRt 


t.  FtRFORMINO  OROAMIZATiON  NAMt  AND  AOORIIl  «0. 

Yale  University  - Dept,  of  Coaputer  Science 
10  Hillhouse  Avenue 

New  Haven,  Connecticut  06520 

• I.  CONTROLLINO  OFFICf  NAMC  ANO  AOORCM  .li.  .RKRORT  WAOe-  T 

Advanced  Research  Projects  Agency  ( tlj  OctsiMB  978/ 

1400  Wilson  Boulevard  ^a-wtiwesR  s^aiio 

Arlington,  Virginia  22209 43 

U MONifoRiNO  AOCNCV  NAME  * AOORKOVN  OtIfMOTI  <mm  CaMralKNO  ONIca;  ••.  ttCURITV  Ct Att.  (•!  Oil*  n^o») 

Office  of  Naval  Research  TTt  ) 

Information  Svstems  Proeran  I Unclassified 

V.--f  / / TITTiZLAiiiPrETYioNTBowNSRAi 

Arlington,  Virginia  22217  J H*  I •eniouLe 


Unclassified 

U.  OfCLAStH^ICFTlON/OOWNORAOINO 
OCHtOULe 


l«.  DiSTRIOUTiON  STATCMCNT  (oI  thU  mamotl) 

Distribution  of  this  report  is  unlimited 


DISTRIBUTION  STATEMENT  A 

Approved  lot  public  leloose; 
DisUibution  Uidimited 


1 17.  DiSTfllBUTlON  STATEMENT  (0/  fh«  In  I#  dififml  tmm 


I Ip.  fU^^LCMCNTAAV  NOTES 


It-  KEY  WONOS  CCofirlfHM  o«i  fvnf  *1^  If  nnftfy  ^ IPMilfp  Sr  MecA  maRb«f> 

goals  Inference 

artificial  intelligence  semantics 


natural  language 
represen tat ion 


Iso.  aOSTAACT  rCofillmi#  on  vld*  If  n»c»»««rr  amP  IPMillfr  Sr  StAcS  imwSAr) 


The  problem  of  controlling  inferences  is  one  of  the  most  serious  in  AI. 
New  types  of  gonl  and  plan  inferences  seriously  compound  the  problem. 
This  paper  attempts  to  outline  one  possible  solution  to  controlling  in- 
ferences, namely  following  »fhat  is  interesting  and  ignoring  what  is  not. 


DO 


FORM 
JAN  71 


COITION  OF  I NOV  ••  l«  OStOLCTC 

$>l  0I02-LF-OI4.46O1 


ABSTRACT 


The  problem  of  controlling  Inference  Is  one 
of  the  most  serious  In  Artificial 
Intelligence.  New  types  of  goal  and  plan 
Inferences  seriously  compound  the  problem. 
This  paper  attempts  to  outline  one  possible 
solution  to  controlling  Inferences,  namely 
following  *»hat  Is  interesting  and  Ignoring 
%«hat  is  not. 


A 

I 


I 


OFFICIAL  DISTIRUBTION  LIST 


Defense  Docusnentatlon  Center 
Caaeron  Station 
Alexandria,  Virginia  22314 


12  copies 


Office  of  Kaval  Research 
Inforaatlon  Systems  Program 
Code  437 

Arlington,  Virginia  22217 


2 copies 


Office  of  Naval  Research 
Code  1021 P 

Arlington,  Virginia  22217 


Advanced  Research  Projects  Agency 
Cybernetics  Technology  Office 
1400  Wilson  Boulevard 
Arlington,  Virginia  22209^ 


3 copies 


Office  of  Naval  Research 
Branch  Office  - Boston 
495  Summer  Street 
Boston,  Massachusetts  02210 


Office  of  Naval  Research 
Branch  Office  - Chicago 
536  South  Clark  Street 
Chicago,  Illinois  60615 


copy 


Office  of  Naval  Research 
Branch  Office  - Pasadena 
1030  East  Green  Street 
Pasadena,  California  91106 


copy 


Mr . Steven  Wong 

Administrative  Contracting  Officer 
New  York  Area  Office 
715  Broadway  - 5th  Floor 
New  York,  New  York  10003 


copy 


Naval  Research  Laboratory 
Technical  Information  Division 
Code  2627 

Washington,  D.C.  20375 


6 copies 


Dr,  A.L.  Slafkosky 
Scientific  Advisor 
Commandant  of  the  Marine  Corps 
Code  RD-1 

Washington,  D.C.  203PO 


copy 


1 

.V 

f 

i'- 

— 2 ~ 

•f'. 

Office  of  Naval  Research 

Code  455 

Arlington,  Virginia  22217 

4’-  • 

Office  of  Naval  Research 

Code  458 

Arlington,  Virginia  22217 

c • 

i 

Naval  Electronics  Laboratory  Center 

Advanced  Software  Technology  Division 

Code  5200 

San  Diego,  California  92152 

1 

S' 

Mr.  E.H.  Glelssner 

Naval  Ship  Research  and  Developnent 
Conputatlon  and  Matheaiatlcs  Departnent 
Bethesda,  Maryland  20084 

F 

Captain  Grace  M*  Hopper 

NAICOM/MIS  Planning  Board 

Office  of  the  Chief  of  Naval  Operations 
Washington,  D.C.  20350 

Mr.  Kin  B.  Thonpson 

Technical  Director 

Information  Systems  Division 

OP-9 IT 

Office  of  the  Chief  of  Naval  Operations 
Washington,  D.C.  20350 

Advanced  Research  Project  Agency 

Information  Processing  Techniques 

1400  Wilson  Boulevard 

Arlington,  Virginia  22209 

He>''* 

Professor  Omar  Wing 

Columbia  University  In  the  City  of  New  York 
Department  of  Electrical  Engineering  and 
Computer  Science 

New  York,  New  York  10027 

I 

Office  of  Naval  Rosenrrh 

Asslslnnt  Chief  for  Technology 

Cod«'  200 

Arllngt»>n,  Virginia  72217 

1 

Captain  Richard  1..  Martin,  USN 

Commanding  Officer 

USS  Francis  Marlon  (LPA-249) 

FPO  New  York  09501 

InterPstinpnosR : Coni  roll inp  Tnfrrrnrrs 


1*  Introduction 


One  of  the  central  issues  in  natural  language  understanding 
for  the  last  few  years  has  been  the  problem  of  making  Inferences 
and  controlling  those  Inferences*  Within  our  own  group^  the 
problem  was  brought  to  light  most  clearly  by  the  work  of  Sieger 
(1973).  Rieger's  theory  was  that  inference  was  a spontaneous 
mechanism.  Thus,  each  of  his  sixteen  classes  of  Inferences  was 


Intended  to  fire  off  for  every  conceptualization  (i.e.  every 
state  or  event)  that  entered  an  understanding  system.  Since  each 
new  Inference  was  also  to  be  treated  as  an  Input  to  the  system. 
It  too  would  be  submitted  to  the  Inference  mechanism,  thus 


creating  a combinatorial  explosion.  Rieger's  theory  just  didn't 


One  of  the  reasons  it  didn't  seem  right  can  be  Illustrated 


by  an  example  I brought  up  which  I later  labelled  as  "the 


Huhammed  All  problem' 


Rieger's  program,  when  presented  with  a 


sequence  such  as  (1) 


(1)  John  was  walking  down  the  street 
Mary.  He  walked  over  and  hit  her. 


would  begin  to  speculate  on  the  state  of  Mary's  health,  and  the 


reasons  for  John's  actions.  Tliese  inferences  fired  from  the 


underlying  conceptual  action  PROPEL 
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The  "MuheMcd  All  problro”  cen  be  seen  by  substituting 
Kuheaard  All  for  Mary  In  tho  nnmo  story; 

(2)  John  wns  walblng  down  tho  street  when  he  spotted 

Muhaaned  All*  He  walked  over  and  hit  hlai* 

Here,  although  Rieger's  program  would  not  detect  the  difference, 
most  readers  find  themselves  speculating  about  any  number  of 
possible  Inferences,  the  very  last  of  which  has  to  do  with 
possible  negative  state  changes  of  All's  health.  In  fact,  more 
likely  In  that  regard,  is  to  mnder  exactly  what  night  have 
happened  next*  That  Is,  we  are  far  more  inclined  to  wonder  about 
John's  health.  (If  you  do  not  pet  this  Idea  from  substituting 
All  for  Mary  because  of  some  knowledge  about  professional 
fighters,  try  substituting  "e  policeman"  for  Mary.  The  effect 
should  be  the  same.) 

Simply  stated,  the  Muhammed  All  problem  points  out  that 


certain  inferences  are  more  likely  to  be  noticed  than  others  in 
given  contexts.  That  is,  it  seems  clear  that  humans  have  some 

I 

method  of  controlling  inferences  that  allows  them  to  focus  on 

Important  things  rather  than  unimportant  things.  | 

i 

One  of  our  first  solutions  to  this  problem  was  the  Idea  of  a 
script  (Schank  and  Abelson  (1977)).  Scripts  facilitate  the 
processing  of  connected  text  (Culllngford  (1977)),  particularly  | 

j 

text  describing  mundane  stereotyped  situations.  We  came  up  with  \ 


the  Idea  of  scripts  at  least  In  part  because  of  Che  problem  of 
controlling  Inference  set  up  for  us  by  Rieger.  It  seemed  obvious 
that  tdien  a hamburger  was  served  In  a restaurant,  even  though  all 


ipaam-* 
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the  Inferences  from  PTRANS  were  certainly  valid  (the  hamburger 
was  now  on  the  table;  It  was  not  where  It  was  before;  the 
waitress  must  have  wanted  the  hamburger  to  be  on  the  table;  John 
must  have  wanted  to  control  the  hamburger,  etc)  they  were  clearly 
not  the  point-  We  found  that  wc  could  control  the  Inference 
process  by  using  the  Information  that  main  events  In  one  scene  of 
a script  were  usually  strongly  related  to  main  events  in 
subsequent  scenes  of  the  script-  Thus,  the  most  significant 
Inference  of  "serving"  Is  that  It  enables  "eating"-  It  would 
have  taken  Rieger's  program  a great  many  steps  to  Infer  that,  but 
SAM  (Culllngford's  script  appller  mechanism)  did  It  rather 
easily- 

Sometimes  hov^ever,  the  solution  to  a problem  has  as  Its 
maximum  value  the  pointing  out  of  new  more  Important  problems- 
This  Is  what  happened  In  this  case-  Scripts  clearly  account  for 
only  a very  small  part  of  our  language  understanding  faculty- 
Few  stories  are  entirely  script-based-  In  Investigating  what 
underlies  scripts,  we  came  back  to  the  original  problem-  We 
described  In  Schank  and  Abelson  (1977)  a theory  of  plans  and 
methods  to  carry  out  those  plans  (planboxes  and  scripts)-  To 
explain  plans,  we  began  to  investigate  the  goals  that  we  might 
expect  to  give  rise  to  them-  At  the  same  time  as  this  theory  was 
being  developed,  two  of  my  students  began  writing  computer 
pr«'grnms  to  mnk»'  use  of  those  notions-  The  programs  that  they 
developed  make  heavy  use  of  goals  and  plans- 


■v,>- 
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An  exaaple  of  their  input -output  la  shown  below: 


PAM  (tnkfn  f r«nii  W<  I rr^lcy , |07H) 


9RUN  PAM 


*(UMDERSTAND  CD6) 


THE  STORY  IS 


JOHN  WANTED  BILL'S  BICYCLE. 

HE  WENT  OVER  TO  BILL  AND  ASKED  HIM  IF  HE  WOULD  GIVE  IT  TO  HIM. 
BILL  REFUSED. 

JOHN  TOLD  BILL  HE  WOULD  GIVE  HIM  FIVE  DOLLARS  FOR  IT,  BUT  BILL 
DID  NOT  AGREE. 

THEN  JOHN  TOLD  BILL  HE  WOULD  BREAK  HIS  ARM  IF  HE  DIDN'T  LET  HIM 
HAVE  IT. 

BILL  GAVE  HIM  THE  BICYCLE. 

■Hie  following  is  a question  answering  session  with  PAM: 


A(DOQA) 

QUESTION:  Q1 

Why  did  John  walk  over  to  Bill? 

Because  he  wanted  to  get  his  bicycle. 

QUESTION:  Q2 

Why  did  Bill  give  his  bicycle  to  John? 

Because  he  didn't  want  to  get  hurt. 

QUESTION:  03 

What  *»ere  the  ronscquences  of  John's  walking  over  to  Pill? 

This  enabled  him  to  ask  him  to  give  him  Bill's  bicycle. 

QUESTION:  Q4 

What  were  the  consequences  of  John's  asking  Bill  to  give  him 
Bill's  bicycle? 

Bill  told  him  that  Bill  %K>uldn't  give  him  Bill's  bicycle. 

The  following  are  paraphrases  In  English  offered  by  Pam  from 
the  various  actors'  points  of  view: 


A (TELL) 


WHO  SHOULD  TELL  THE  STORY?  *JOHN 
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I wanted  to  get  Bill's  blcyrle.  So  I walked  over  to 
him,  and  I asked  him  to  hand  It  over*  Ke  told  me  that 
he  wouldn't  hand  it  over*  So  I aksed  him  to  sell  It  to 
me  for  five  dollars.  Then  he  told  me  that  he  wouldn't 
hand  over  his  bicycle.  I told  him  that  If  he  didn't 
hand  It  over  then  I would  break  his  arm.  He  handed 
over  the  bicycle. 


WHO  SHOULD  TELL  THE  STORY?  *P.ILL 


John  came  over.  He  asked  me  to  give  him  my  bicycle.  I 
wanted  to  keep  the  bicycle,  so  I told  him  that  I 
wouldn't  give  It  to  him.  Then  he  offered  to  buy  It  for 
five  bucks.  I wanted  to  keep  the  bicycle,  so  I told 
him  that  I wouldn't  give  It  to  him.  He  told  me  that  If 
I didn't  then  he  would  break  my  arm.  I didn't  want  to 
get  hurt.  So  I gave  him  my  bicycle. 


POLITICS  (taken  from  Carbonell,  197P) 


******************************************************** 

Start  of  POLITICS  Interpretations  and  QA  dialogs 

******************************************************** 


INPUT  STORY:  +THE  US  CONGRESS  IS  EXPECTED  TO  APPROVE  THE 

PANAMA  CANAL  TREATY. 


♦(INTERPRET  US -CONSERVATIVE) 


Ql:  SHOULD  THE  US  APPROVE  THE  TREATY? 

Al:  NO,  THE  TREATY  IS  BAD  FOR  THE  UNITED  STATES. 

Q2:  WHY  IS  THE  TREATY  BAD  FOR  THE  US? 

Al:  THF  UNITED  STATES  WOULD  LOSE  THE  CANAL  TO  PANAMA 
AND  THF  UNITED  STATES  WILL  BE  WFAKER. 

Q3:  WHAT  MIGHT  HAPPEN  IF  THE  UNITED  STATES  LOSES  THE  CANAL? 
A3:  RUSSIA  WILI.  TRY  TO  CONTROL  THE  CANAL. 


Q4:  WHY  WOULD  RUSSIA  TRY  TO  TAKE  OVER  THE  CANAL? 
AA:  RUSSIA  WANTS  TO  EXPAND  ITS  MILITARY  CONTROL. 
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THE  PANAfl/k  CANAI.  HAS  HU:il  MII.ITARY  VAI.HE. 

O'?:  HOW  MICHT  IT  HAPPEN? 

A5:  THE  UNITED  STATES  MAY  NOT  BE  ABLE  TO  STOP  ANYONE 

TAKING  OVER  THE  PANAMA  CANAL.  TORPIJOS  IS  A COMMUNIST. 
TORRIJOS  WILL  LET  RUSSIA  CONTROL  PANAMA. 

06:  WHY  SHOULD  THE  US  WORRY  ABOUT  RUSSIA  TAKING  OVER  THE  CANAL? 
A6:  BECAUSE  RUSSIA  WANTS  TO  CONTPOL  THE  WORLD. 

Q7:  THEY,  WHAT  SHOULD  THE  US  DO  TO  STOP  THE  SOVIETS  FROM 
TAKING  THE  CANAL? 

A7:  CONGRESS  SHOULD  VOTE  AGAINST  THE  PANAMA  CANAL  TREATY. 

Q8:  WHAT  ELSE  CAN  THE  US  DO  TO  KEEP  THE  CANAL? 

A8:  THERE  ARE  NO  OTHER  GOOD  ALTERNATIVES. 

* (INTERPRET  US-LIBERAL) 

Ql:  SHOULD  THE  US  APPROVE  THE  TREATY? 

Al:  YES,  THE  PANAMA  CANAL  TREATY  IS  GOOD  FOP.  THE  UNITED  STATES. 
Q2:  WHY  IS  THE  TREATY  GOOD? 

A2;  THE  PANAMA  CANAL  TREATY  IMPROVES  RELATIONS  WITH  LATIN 

AMERICAN  COUNTRIES.  IT  LFTS  EVERY  COUNTRY  USE  THE  CANAL. 

Q3:  WHAT  HAPENS  IF  THE  US  KEEPS  THE  CANAL? 

A3:  THIS  WILL  CAUSE  DISCONTENT  AND  CONFLICT  IN  PANAMA  AND 
LATIN  AMERICA. 

04:  WHY  WOULD  THIS  LEAP  TO  A CONFLICT? 

A4:  THE  CANAL  ZONE  IS  A UNITED  STATES  COLONY.  LATIN  AMERICA 
• DOES  NOT  LIKE  COLONIALISM.  THE  UNITED  STATES  WOULD  MAINTAIN 
COLONIALISM. 

05:  BUT,  WHAT  IF  RUSSIA  TRIES  TO  TAKE  OVER  THE  CANAL? 

A5:  RUSSIA  DOES  NOT  WANT  CONFLICT  WITH  THE  US.  RUSSIA 

WILL  STAY  OUT  OF  THE  CANAL  IF  THE  UNITED  STATES  DEFENDS 
IT.  THE  UNTED  STATES  DEFENDING  THE  CANAL  IS  PART  OF  THE 
TREATY. 

Q6:  WHAT  SHOUI.D  THE  US  DO  NEXT  ABOUT  THE  CANAL? 

A6:  THE  US  SHOULD  DO  NOTHING  AFTER  CONGRESS  APPROVES 
THE  PANAMA  CANAL  TREATY. 

While,  I believe  the  work  of  Wllensky  and 
Carbonell  to  be  extremely  Impressive,  there  does  exist 
an  important  flaw  in  the  reasoning  behind  both  of  them. 

They  both  proceeded  under  the  assumption  that  a) 1 goals 
and  plans  of  al 1 actors  In  a story  must  be  constantly 
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monitored*  It  would  not  br  appropriate  to  criticize 
that  assumption  for  tw  reasons*  First,  the  texts  they 
designed  their  systems  to  work  on  were  constructed  such 
that  this  assumption  was  very  useful;  they  were  trying 
to  Investigate  goal-based  texts.  The  second  reason  is 
that  the  theory  Abelson  and  I were  designing  encouraged 
exactly  that;  goals  and  plans  had  to  be  monitored  all 
the  time* 

The  problem  with  this  assumption  Is  that  It  leads 
you  right  back  to  the  uncontrolled  Inference  problem* 

If  we  must  ask  about  the  goals  and  plans  of  every  actor 
we  hear  about,  we  will  be  concentrating  on  a great  deal 
of  useless  detail* 

Consider,  for  example,  the  following  sentence* 

(3)  A small  twin  engine  airplane  carrying  federal 
marshals  and  a convicted  murderer  who  was  being 
transported  to  Leavenworth  crashed  during  an  emergency 
landing  at  O'llare  Airport  yesterday* 

Taking  seriously  the  Idea  of  following  all  the  goals  and 
plans  of  the  actors  causes  os  to  make  goal  and  plan  type 
Inferences  In  (3)  for  the  federal  marshals,  the  murderer,  the 
pilot  of  the  plane,  and  possibly  also  the  people  In  the  control 
tower  (to  which  "emergency  landing"  Implicitly  refers.)  Thus  we 
are  left  with  Inferring  that  the  marshals  hove  the  goal  of 
transferring  the  murderer  to  prison;  that  they  have  this  goal 
hecaiiHc  of  a higher  level  goal  Involving  a Job;  that  this  job  Is 


a form  of  goal-  subsumption  (sor  V/ilonnky  (197P))  for  the  goal  of 
getting  money;  that  they  are  act  Ing  ns  agents  of  the  federal 


government;  that  the  federal  government  has  the  goal  of  putting 
the  murderer  In  jail  and  so  on»  We  could  also  infer  why  the 


government  wants  to  put  the  murderer  In  jail,  why  the  pilot 
doesn  t want  his  plane  to  crash,  why  the  control  tower  doesn't 


%»ant  the  plane  to  crash  and  go  on  In  this  fashion  Indefinitely 


We  are  left.  In  our  new  model  of  understanding,  with 


situation  far  worse  than  the  one  we  were  Initially  trying  to 


correct.  By  Inventing  new  classes  of  Inferences  to  control  the 


inference  explosion  problem,  we  have  compounded  our  problem 


2.  What  Path  to  Follow 


It  seems  unlikely  that  people  actually  think  about  why  the 
federal  marshals  are  doing  what  they  are  doing  In  (3).  On  the 
other  hand,  we  cannot  entirely  Ignore  their  goals  either.  Tf  the 


story  had  been 


(4)  An  airplane  carrying  t%»D  orangutans  and  a convicted 
murderer  who  was  being  transported  to  Leavenworth... 


we  would  certainly  not  Infer  that  the  orangutans  were  taking  the 
murderer  to  prison.  Tliat  Is,  the  SOCIAL  CONTROL  relationship 
between  the  marshals  and  the  murderer  Is  crucial  and  must  be 


Inferred 
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But  how  much  further  In  our  Inference  path  do  we  have  to  go? 
Need  we  Infer  *rhy  the  marshal  a arc  in  a SOCIAL  CONTROL 
relationship?  Should  we  begin  to  infer  %diat  their  goals  are? 
Both  POLITICS  and  PAM  say  yes,  but  it  seems  obvious  that  at  some 
point  the  answer  must  be  no.  We  must  control  the  Inference 
process  before  It  controls  us. 

The  question  before  us  then  Is  to  what  extent  we  should 
follow  a given  path  In  a story.  That  is,  which  Inferences  are 
worth  making  and  which  arc  not?  The  answer  Is  obvious  - we  need 
only  make  the  Inferences  that  help  tie  together  the  text.  This 
answer  was  first  proposed  in  Schank  (1975)  as  a partial  solution 
to  the  problem  of  controlling  Inference  in  a system  for 
understanding  stories.  There  are  two  problems  with  this  answer. 
First,  the  ability  to  control  inferences  by  tying  together  the 
text  depends  on  our  knowing  before  hand  what  Inferences  will  lead 
naturally  in  that  direction.  How  are  v»e  to  know  which  goals  of 
the  federal  marslials  arc  Irrelevant?  We  could  spend  time  trying 
to  tie  together  a text  by  processing  all  the  goals  in  a story. 
So,  this  proposal  solves  nothing  unless  we  know  where  to  look  for 
the  Information  that  will  be  of  use  in  tying  together  text. 

In  Schank  (1975)  the  needed  information  came  from  knowledge 
about  causality.  Tying  together  text  meant  constructing  a causal 
chain  of  the  states  and  events  in  the  text.  This  could  be  done 
because  vp  could  easily  store  the  normal  enablements  and  results 
emanating  from  any  given  state  or  action.  (Remember  that  we  use 
a system  of  primitive  states  and  actions  and  that  there  are  very 


\ 
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few  of  these)*  Also,  we  had  one  event  at  a tine  to  try  and 
connect  up  to  a preceedlng  event.  Rut,  on  the  higher  level  of 
goals  and  plans  wo  do  not  know  where  to  start.  Whose  goals  and 
plans  should  we  follow? 

The  second  problem  with  this  solution  Involves  the  actual 
nechanlsm  for  tying  together  events.  While  there  nay  well  be 
causal  chains  of  events.  It  seens  less  likely  that  there  are 
causal  chains  of  goals  and  plans.  What  exactly  does  tying 
together  mean  here? 

To  return  to  our  question:  what  Inference  path  should  we 
follow  In  understanding  a story?  Let  me  suggest  a simple  answer. 
We  should  follow  the  path  that  is  Interesting,  of  course. 


"Ji 


I This  answer  seems  trivially  obvious.  Furthermore  It  depends 

on  a definition  of  Interestingness.  What  I shall  attempt  to  do 
^ now  is  to  define  interestingness,  motivate  its  usefulness  In 

understanding,  and  write  some  rules  for  using  Interestingness  as 

! 

i a method  for  controlling  Inferences. 

I 


3.  Tntercstlngness 


Wtt.1t  mnkos  .1  story  I ntert'st  Ing?  Consider  the  following: 


(5)  I wont  to  Germany  for  my  vacation.  On  one  sunny 
day,  T took  a walk  along  the  streets  of  Munich.  First, 
I bought  a lemonade  from  an  old  man.  Then  T saw  some 
nice  shop  windows,  an  Interesting  statue,  and  visited  a 
museum.  I saw  a nice  hill  and  climbed  up  It  only  to 
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rin<l  .'inollicr  till  I whirl*  I .1 1 lui  rllmhtsi*  I w.is  hot  .‘ind 
tirod  and  docldtHi  lo  find  my  way  hark.  As  T looked 
over  the  next  hill  heforo  turnlnf'  back,  T saw  in  the 
valley  below  an  aimy  marching  towards  me.  Behind  me,  I 
saw  another  army.  Soon  a battle  broke  out.  I learned 
the  next  day  that  Turkey  had  Invaded  Germany.  They  had 
been  repelled  and  the  Incident  was  hushed  up.  Ho  one 
else  knew  about  It. 


In  reading  this  story  certain  things  are  obviously  more 
Interesting  than  others.  The  "lemonade"  and  the  "museum"  are 
easily  forgotten.  On  the  other  hand,  the  invasion  Is  not  easily 
forgotten.  The  last  half  of  the  story  would  be  fascinating  If 
anyone  believed  It.  Put  vihy  Is  it  that  the  subject  of 
bellevablllty  doesn't  come  up  for  the  first  part  of  the  story? 
Furthermore,  %fhy  do  there  appear  to  be  two  distinct  parts  of  the 
story? 

The  answer  to  all  of  these  questions  has  to  do  with  the 
concept  of  "Interestingness".  When  something  Is  deemed  to  be  of 
Interest,  It  Is  tracked  by  the  reader.  That  Is,  we  pay  attention 
to  It.  What  does  pay  attention  mean?  It  means  that  we  let  our 
inference  processes  loose.  Since  this  Is  nothing  new,  the  Import 
of  this  Idea  can  only  be  that  wo  are  less  willing  to  let  our 
Inference  processes  loose  when  a story  or  part  of  a story  Is 
uninteresting. 

Where  does  this  concept  of  Interestingness  come  from  and 
where  will  we  find  It  during  the  course  of  processing?  To 


f 


further  examine  this  consider  the  following  sentences: 


(6)  John  wns  walking  down  the  street  when  suddenly: 
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a)  he  saw  a cat 

b)  he  decided  to  tie  his  shoe 

c)  he  decided  to  eat  a cookie 

d)  he  decided  to  eat  some  chalk 

e)  he  decided  to  drink  the  bottle  of 
Mr*  Clean  he  Just  bought 

f)  he  heard  a loud  noise 

g)  he  heard  an  explosion 

h)  he  heard  an  Incredible  boon 
1)  he  heard  a meow 


To  get  a feel  for  what's  going  on  here.  It  Is  worthwhile  to 
attempt  to  characterize  these  sentences  In  terms  of  their 
potential  Interest*  It  seems  obvious  that  a,b,c,  and  1 are 
entirely  uninteresting*  In  fact,  they  are  a little  weird, 
because  the  "suddenly"  In  (6)  biases  the  reader  to  expect 
something  Interesting*  On  the  other  hand  d and  e are  relatively 
Interesting  (e  more  than  d)  and  similarly  f,g,  and  h are 
Increasingly  Interesting*  This  leaves  us  with  a simple  theory* 
First  we  have  a relative  rule:  unusual  things  are  more 
Interesting  than  usual  ones*  And  second,  we  have  some  absolute 
rules:  noises  are  Interesting,  the  louder  the  better,  and  the 
111  effects  of  eating  Inedible  things  are  Interesting,  the 
deadlier  the  better. 


These  may  scorn  like  strange  rules  but  they  will  do  for 

starters*  To  consider  It  better,  let's  look  at  two  stories  that 

are  struc tore'll  1 y identical  but  vary  In  the  Interest  value  of  the 

words  (or  concepts)  contained  within  them: 

(7)  John  was  walking  down  the  street  eating  an  Ice 
cream  cone*  He  saw  a man  walk  Into  the  bushes  and 
begin  to  undress*  Soon  a crowd  had  gathered  and  the 
police  came  to  Investigate*  While  they  were  there  a 
giant  explosion  occurred  two  blocks  away.  People  came 
running  In  their  direction  screaming  that  there  had 
been  a terrible  accident*  Many  were  bleeding  and  one 
man  had  lost  an  arm*  Meanwiille  a fire  broke  out  In  the 
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park*  People  aald  there  was  a conspiracy  afoot  because 
a bomb  had  been  sighted  nearby  only  yesterday*  When  an 
epidemic  broke  out  the  following  week,  everyone  knew 
the  al lens  had  landed  * 


(P)  John  was  walking  down  the  street  eating  an  Ice 
cream  cone*  Re  saw  a man  walk  into  the  park  and  begin 
to  read*  Soon  some  pigeons  had  gathered  and  a boy  came 
to  feed  them.  While  they  were  there  a truck  drove  by  a 
few  blocks  away*  People  who  came  walking  towards  the 
park  said  that  it  was  a diesel  truck*  Many  were  hot 
and  one  man  was  really  sweating.  Meanwhile  the  park 
got  really  crowded.  People  said  there  was  a new  park 
being  built  nearby  because  a construction  crew  had  been 
sighted  only  yesterday.  When  construction  began  the 
follo%dng  week,  everyone  knew  that  the  mayor  had  kept 
his  promise. 

Assuming  that  (7)  Is  more  interesting  than  (8),  the  question 
is  why?  To  answer  this,  we  must  propose  some  absolutly 
interesting  things.  Consider  one  mentioned  above,  noise: 


Noises  are  Interesting  because  they  can  indicate  impending 
catastrophe.  Thus,  when  we  read  about  an  explosion  in  downtown 
we  are  Interested,  perhaps  because  we  ourselves  might  have  been 
there  and  might  have  been  hurt.  So,  what  really  is  interesting 
about  noises  is  their  potential  harm*  The  first  interesting 
thing  we  have  then  la  PFATH* 


1 - DF.ATH*  Death  Is  Interesting  (one  would  suppose)  because 
everyone  Is  worried  about  It  happening  to  them*  But,  death  Is 
obviously  not  absolutely  interesting*  Few  people  consider  the 
obituaries  to  be  the  most  Interesting  part  of  the  paper.  This  Is 
because  death,  particularly  at  old  ages,  is  usual  and  expected. 
Tills  lends  us  to  our  second  category  of  Interestingness: 


2 - UNEXPECTED  EVENTS.  The  probl**»  with  using  UNEXPECTED  EVENTS 


as  an  Interestingness  category  Is  that  It  inplles  a model  of 
expectation  which  In  turn  means  we  will  need  a particular  world 
model.  Clearly  what  Is  expected  for  one  person  might  not  be  for 
another.  Now  there  Is  nothing  wrong  %rlth  that  because  what  Is 


Interesting  for  one  person  might  not  be  for  another  also.  The 


problem  Is  that  while  (1)  was  absolute  (2)  Is  relative  to 


whomever  we  are  talking  about.  What  we  can  do  here  is  to  apply 


(2)  as  an  operator  on  (1).  Thus  UNEXPECTED  DEATHS 


interesting 


This  will  work  partially,  but  not  completely.  Obviously 
when  we  hear  that  John  Smith  died  it  is  not  expected  if  ve  did 


not  know  of  his  existence  previously.  It  is  also  clearly 
uninteresting.  There  are  exceptions  to  this  however.  If  John 


Smith  is,  say  9 years  old,  and  you  have  a 9 year  old  boy  of  your 


own,  you  might  find  it  Interesting.  (Recall  that  interesting 
here  means  that  we  would  want  to  know  more  about  it,  particularly 
by  paying  attention  to  the  details  and  making  appropriate 
Inferences . ) 


John  Smith's  death  might  also  be  Interesting  if  John  Smith 


Is  a friend  or  relative  of  someone  you  know  or  of  someone 


Important,  or  If  John  died  of  some  ailment  that  might  possibly 
affect  you. 


We  must  add  then  to  our  absolute  interest  DEATH,  and  our 


operator  UNEXPECTED  EVENTS,  a new  absolute  Interest  DANCER,  and  a 


new  operator  PERSONAl.  REl^TEPNESS 


3 - DANGER.  Danp.er  is  Intcrrstlnp  bcrsuso  It  Is  a possible 
prelude  to  DEATH.  iU>wvcr  to  nrp.iio  that  this  is  why  people  find 
it  interesting  might  miss  the  mark.  People  often  put  themselves 


In  situations  that  simulate  danger  but  where  death  is  not  a 


possible  consequent.  Sports  fit  wel J there.  Also,  there  is  the 


danger  of  losing  what  one  values.  This  too  is  interesting  and 


might  have  nothing  to  do  with  death 


4 — PERSONAL  RELATEDNESS  — Personal  Relatedness  is  an  operator 


because,  like  UNEXPECTED  EVENTS,  It  Is  really  only  the  PERSONAL 


RELATEDNESS  of  another  Interesting  thing  that  is  interesting. 
Cutting  your  child's  toenails  Is  of  strong  PERSONAL  RELATEDNESS 


but  Is  not  very  interesting.  Thus,  PERSONAL  REl^TEPNESS  alone  Is 


not  necessarily  Interesting.  But,  as  an  operator  on  other 


concepts  It  can  make  things  much  more  interesting  than  they 
Inherently  are.  So,  death  of  a friend  or  danger  to  a relative  Is 


interesting 


Other  absolute  Interests  are:  POWER;  SEX;  MONEY  (In  large 


quantities);  DESTRUCTION 


CHAOS 


R(»fANCF 


DISEASE  and  many 


other  concepts  and  issues  of  this  type 


There  is  also  a kind  of  situational  interest.  This  Is  the 


ease  wliere  the  Items  themselves  are  not  necessarily  Interesting 


Thus 


IRONY  and  DILEMMAS  are 


Interesting 
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So  what  la  Interesting  according  to  the  above?  If  soneone 
you  knew  died  froa  having  sex  for  a lot  of  aoney,  that  would  be 
very  Interesting  by  ay  rules*  Slallarly  If  your  house  burned 
down  that  would  be  Interesting,  as  would  an  epldealc  In  your 
neighborhood • 

My  point  here  Is  not  to  list  out  everything  that  could  ever 
be  Interesting*  That  can  and  should  be  done  through  methods  more 
rigorous  than  I have  used  here*  My  point  Is  simply  that  people 
do  have  such  metrics*  The  question  now  before  us  Is:  how  do 
they  use  them? 


4*  The  Use  of  Interest  Values 

In  general,  people  are  concerned  with  why  they  are  being 
told  a given  piece  of  Information*  Thus,  for  every  Input  an 
understander  attempts  to  determine  his  need  to  know  it*  The 
major  Issue  Is  how  much  work  an  understander  should  do  in  the  way 
of  Inference  at  any  given  point*  The  problem  then  Is  really  when 
to  be  top  down  and  when  to  he  bottom  up*  It  is  always  neater  to 
be  top  down,  to  have  some  overall  framework  into  which  we  are 
trying  to  fit  things  and  later  to  use  that  framework  to  interpret 
what  we  hear*  But  there  Is  a problem  with  unexpected  Information 
or  Interesting  Information*  Since  understanders  always  notice 
such  Information,  the  question  we  must  ask  is  'how?'  The 
detection  of  aiich  Information  would  seem  to  be  a bottom  up 
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process  beceuse  ve  cannot  expect  something  to  be  unexpected  or 
Interesting*  However*  while  assessing  Initial  unexpectedness  Is 
certainly  bottom  up,  the  explanation  for  It  Is  dependent  on 
Interest  and  relevance*  Assessing  Interest  therefore  Is  a 
process  which  Is  both  top  down  and  bottom  up. 

Consider  the  following  two  stories: 

(9)  (10) 


Jonn  went  to  visit  Mary 
They  had  tea* 

He  was  about  to  suggest 
they  go  for  a walk  when 
he  spilled  the  tea  on  Mary* 
He  apologized  and  vent  home 


Sam  went  to  visit  Fred 
They  had  a beer* 

Sam  was  about  to  suggest  that 
they  play  some  basketball  when 
he  spilled  the  beer  on  himself 
He  went  home. 


How  much  plan,  goal  and  other  intentional  inferences  are 
appropriate  in  understanding  these  stories?  In  (9)  we  seem  to 
recognize  what  John  had  In  mind  and  feel  for  him*  In  (10)  no 
such  Issues  arise.  Were  we  figuring  out  their  plans  and  goals  in 
either  case?  Another  way  of  putting  this  Is:  When  Sam  visits 
Fred  do  we  ask  ourselves  - Why?  If  not,  then  why  do  we  In  (9)? 
If  we  do,  then  how  do  we  decide  to  stop  looking  for  an  an8%rer? 
Wliy  are  *»p  content  to  process  on  without  answering? 

One  obvious  answer  here  Is  that  In  understanding  these 
stories,  certain  scripts  are  activated.  Some  of  these  scripts 
are  simply  more  interesting  than  others.  In  particular,  'tea' 
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calls  to  nlnd  the  courting  script  and  since  the  courting  script 
has  to  do  with  ROMANCE  It  Is  to  some  extent  interesting.  This  Is 
not  the  case  in  (10).  Nothing  of  interest  comes  to  mind  In  the 
visiting  a friend  script. 

The  point  then  Is  that  the  Inference  of  goals  and  plans  may 
not  be  made  unless  we  are  interested  In  the  characters 
intrinsically  or  In  some  of  the  circumstances  that  the  characters 
find  themselves  In.  The  Idea  that  we  only  make  Inferences  when 
we  are  interested  leads  us  to  another  issue  that  Is  obvious  in 
the  stating  but  somehow  has  been  overlooked  In  AI  research, 
namely  the  question  of  speed. 

One  of  the  reasons  that  %»e  do  not  make  all  the  inferences 
all  the  time  may  be  that  we  simply  do  not  have  the  time.  Recall 
that  Input  Is  coming  In  very  quickly  in  spoken  language  and 
rather  quickly  In  normal  reading  as  well.  One  possibility  is 


that  %#e 

either  figure  it  out 

fast 

or 

else 

we 

ignore 

it 

and 

continue 

on.  The  ramifications 

of 

this 

Idea 

for  how 

we  do 

natural 

language  processing 

are 

tremendous 

and 

It 

Is 

worth 

digressing  here  for  a bit  to  explore  them. 
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5.  Interest-Based  Parsing 

Simply  stated  the  Idea  of  Interest-based  parsing  Is  this: 
It  takes  n microseconds  to  read  a word  and  it  takes  m 
microseconds  to  completely  process  a word.  (By  completely 
process  I mean,  choose  the  correct  meaning.  Integrate  It  fully 
Into  the  overall  representation  of  the  text,  and  make  the 
necessary  Inferences.)  Since  It  seems  quite  likely  that  m Is  much 
larger  than  n In  ordinary  speech  and  reading,  and  since  words 
come  In  continuous  streams  under  those  circumstances,  then  It  Is 
obvious  that  people  cannot  be  fully  processing  every  word  they 
hear  or  read.  What  Is  more  likely  the  case  Is  that  they  are 
deciding  what  to  pay  serious  attention  to  and  what  to  pay  casual 
attention  to  as  they  go.  Such  decisions  can  be  explained  on  the 
basis  of  many  factors,  but  the  most  obvious  of  them  is  Interest. 

Let  us  consider  again  sentence  (3): 

(3)  A small  twin  engine  airplane  carrying  federal  marshals  and  a 
convicted  murderer  who  was  being  transported  to  Leavenworth 
crashed  during  an  emergency  landing  at  O'Hare  Airport  yesterday. 

It  seems  obvious  that  some  parts  of  this  sentence  are  more 
Interesting  than  others.  But  more  Important  than  that,  our  ideas 
stated  above  concerning  the  processing  time  available  would  seem 
to  Imply  that  the  processing  of  some  words  must  take  less  time 
than  the  time  It  takes  to  read  or  hear  them!  Let's  sec  why  that 
Is.  We  said  above  that  It  Is  likely  that  the  time  It  takes  to 


fully  process  8om<'  words  must  take  more  time  than  It  takes  to 


d 


Page  20 


hear  or  read  them*  Yet  the  total  amount  of  processing  time 
available  Is  limited  by  the  rate  of  the  flow  of  Input  (which  Is 
continuous  for  speech).  That  Is,  it  generally  takes  no  longer  to 
understand  a sentence  than  It  does  to  hear  It.  So,  If  we  need  to 
fully  process  some  word  because  It  Is  Interesting  or  Important, 
that  processing  must  be  done  at  the  expense  of  processing  other 
words  at  all. 


The  alert  reader  will  have  noticed  that  this  argument 
assumes  humans  do  not  use  any  parallel  processing  capabilities  In 
understanding.  Even  If  they  do,  though.  It  seems  to  me  that  the 
total  processing  capability  for  use  In  understand  inf  must  have 
some  bounds,  and  that  the  speed  of  Input  must  often  overwhelm 
those  bounds.  Thus  we  are  still  left  with  the  necessity  of 
processing  some  words  at  the  expense  of  others. 


The  Implication 

of  this 

Is  that 

In 

many 

cases 

the 

understanding 

process 

Is  not 

entirely 

left 

to 

right. 

The 

understanding 

process 

must  be 

top-down 

In 

order 

that 

the 

understander  know  what  can  be  Ignored  and  what  Is  Important.  But 
when  we  process  In  a top-down  fashion,  the  'top'  In  a phrase  may 
occur  at  the  end  of  the  phrase.  The  preceding  words  that  had 
been  Ignored  would  then  be  'gathered  up',  right  to  left.  By 
right  to  left,  I mean  that  while  the  stream  of  Input  Is  obviously 
left  to  right,  some  words  are  stored  In  a buffer  and  virtually 
Ignored  until  a w»>rd  that  Initiates  processing  Is  found.  When 
such  a word  Is  found,  the  words  In  the  buffer  are  gathered  up  and 
placed  in  their  appropriate  slots. 
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In  order  to  proress  a noon  pbrnse  of  the  type  that  opens 
sentcnee  (3)  then,  we  muKi  assume  that  a processor  virtually 
ignores  all  the  words  until  'airplane',  slnply  marking  their 
existence  In  short  term  memory  to  be  retrieved  after  the  head 
noun  Is  found*  Once  we  know  that  'airplane'  Is  the  subject  of 
the  sentence,  expectations  can  be  generated  that  allow  us  to  have 
a better  idea  of  what  to  look  for  (and  therefore  of  what  to 
ignore)*  Thus,  'carrying'  can  be  virtually  Ignored  because  while 
we  are  only  beginning  to  recognize  what  word  It  Is,  we  have 
already  heard  about  the  marshals  and  the  murderer  and  have 
decided  to  pay  attention  to  those  Items* 

The  point  here  Is  that  since  we  are  really  not  seeing  things 
one  word  at  a time,  but  rather  In  a contlnous  stream,  we  can  pick 
out  what  we  find  Interesting,  go  back  to  discover  just  those 
relationships  that  connect  together  what  we  are  Interested  in  and 
virtually  Ignore  the  rest*  Do  we  care  that  the  word  'carrying' 
was  used  Instead  of  'transporting',  or  that  the  construction  used 
was  not  'In  v^ich  they  were  flying'?  We  have  already  predicted 
the  relationship  between  the  people  and  the  airplane  based  on 
what  It  ordinarily  Is*  We  need  only  confirm  the  fact  that 
nothing  contradicts  this  prediction. 

One  of  the  consequences  of  this  theory  Is  that  It  should 
take  longer.  In  normal  reading  mode,  to  read  an  Interesting  story 
than  it  does  to  rend  an  otherwise  syntactically  equivalent  dull 
one*  Thus,  (9)  above  should  take  longer  than  (10),  (7)  should 
take  longer  than  (8)  and  sentence  (3)  should  be  faster  than  the 
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equivalent  sentence  In  which  the  actors  are  riding  on  the  plane 
rather  than  In  it.  (It  might  be  rather  difficult  to  actually  get 
such  results  in  an  experiment  however  due  to  the  problem  that 
people  night  very  likely  slow  do%m  when  bored  and  speed  up  when 
excited •) 

A theory  of  Interest-based  parsing  then,  says  that  most 
words  are  barely  noticed  until  some  reason  Is  found  to  pay 
attention  to  them*  We  must  then  ask  what  reasons  there  are  to 
pay  attention  to  a word  and  begin  to  process  It  seriously. 
Reasons  for  continuing  to  process  a given  word  occur  at  all 
levels  of  the  system.  Some  of  these  are: 

Parser  expectations:  If  the  parser  expects  a certain  kind  of 
word,  the  satisfaction  of  that  expectation  can  be  taken  as  an 
extremely  Important  force  in  the  parser.  Thus,  a parser  might 
function  best  that  expected  certain  syntactic  or  conceptual  types 
to  the  extent  that  it  Ignored  everything  else  until  It  found 
them.  This  Is  again  a violation  of  strict  left  to  right  parsing, 
but  this  violation  makes  sense  considering  our  arguments  above. 
(There  is  an  aside  here  that  Is  worth  making  at  this  point.  We 
have  talked  over  the  years  about  how  expectations  drive  various 
parts  of  the  understanding  process  (Rlesbeck,  1975  and 
Culllngford,  1977  for  example).  The  contrast  here  Is  between 
expectation-driven  processes  and  Interest-driven  processes. 
Obviously  the  most  powerful  and  Important  mechanisms  available  to 
an  understander  are  both  expectation  and  Interest  driven  at  the 


same  time.) 
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Syntax:  Main  nouns  in  a noun  phrase  can  cause  a processor  to  try 
to  gather  up  all  relevant  modifiers*  Also,  certain  function 
words  can  force  a processor  to  pay  attention  If  they  might  flag 
something  important  or  expected. 

Interest  values:  How  does  the  parser  decide  what  it  wants  to 
pursue?  Obviously  we  need  a fully  Integrated  system  where  the 
parser  and  memory  talk  during  the  analyxsls  of  a sentence. 
Without  such  integration,  the  memory  could  not  Inform  the  parser 
of  what  to  pay  attention  to.  Interest  values  are  stored  In 
memory  as  part  of  the  knowledge  associated  with  concepts.  As  ve 
have  seen,  certain  concepts  are  absolutely  Interesting.  Others 
are  Interesting  only  under  certain  circumstances  (we  will  discuss 
these  later  on  In  this  paper).  Certain  things  are  Interesting  on 
the  basis  of  \Aiat  has  preceded  them.  Thus,  the  object  of  a 
shooting  might  be  expected  to  be  more  Interesting  If  the  shooting 
took  place  In  an  embassy  as  opposed  to  a generally  low-interest 
location  such  as  a bar.  (But  of  course,  contexts  can  be  created 
where  bars  are  very  Important.  This  Is  why  It  Is  necessary  to 
have  memory  available  as  opposed  to  just  a dictionary.) 


p 


Top  level  expectations:  If  we  are  reading  about  an  event  that 
fits  Into  a high  level  knowledge  structure  such  as  a script  or  a 
plan,  predictions  from  that  script  or  plan  can  focus  interest 
during  the  prorosslng  of  a sentence.  Thus,  wt»  can  know  that  the 


target  of  an  assassination  and  the  Identity  of  the  assassin  are 


of  critical  Importance  In  reading  a story  about  an  assassination 
and  we  can  thus  focus  In  on  those  Items  as  top-down  predictions 
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during  parsing. 


To  see  how  all  this  Is  used  wc  can  return  to  our  original 
examples  (9)  and  (10):  In  a sentence  "X  went  to  visit  Y",  X is 
evaluated  for  Interest  value  by  memory  because  it  Is  a head  noun 
and  because  It  Is  a person-  When  no  Information  Is  found,  the 
processing  should  be  faster  than  wlien  Information  Is  found- 
Thus,  when  X Is  'John'  or  'Sam'  one  proceeds  quickly-  If  X were 
Henry  Kissinger  or  one's  mother  one  would  presumably  proceed  more 
slowly  because  more  expectations  about  their  behavior  would  be 
found.  (Since  they  ate  subjects  of  the  sentence  that  Is  \diat  Is 
relevant  here-) 


'Went'  Is  an  Item  that  urges  us  to  continue  processing  since 
It  has  no  meaning  by  Itself-  (That  Is,  we  could  have  'went 
crazy',  'went  fishing',  'went  to  Boston',  and  we  can't  do 
anything  until  we  see  the  next  few  words-  The  point  here  Is  »(hy 
speculate  at  all,  just  Ignore  It-)  'Visit'  Is  a word  that  calls 
up  a script  ($VISIT)  If  the  object  of  the  visit  Is  an  equal  or  a 
family  member-  But  remember  that  other  scripts  can  be  called  up 
by  the  word  visit  that  are  distinct  from  $VISIT.  If  the  object 
of  visit  Is  'museum'  or  'Congress'  we  would  get  quite  different 
scripts  or  even  no  script  at  all-  (Vhat  script  docs  "went  to 
visit  a mortuary"  bring  up?)  Again,  1 would  claim  that  'visit'  Is 
also  almost  totally  Ignored  since  it  too  means  very  little-  Its 
real  purpose  Is  to  get  us  very  Interested  In  the  object  that 
follows  next-  That  Is,  we  don't  really  start  processing  this 
sentence  seriously  until  we  see  what  Y is-  Then,  If  Y Is  a 


■< 

I 
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relative  or  friend  then  we  Instantiate  $VTSIT.  If  Y Is  a nenber 
of  the  opposite  sex,  vc  have  an  ambiguous  sentence  from  a 
scrlptal  (and  thus  from  a processing)  point  of  view.  In  that 
case,  either  $V1SIT  or  $ROMANCE  would  be  applicable,  and  we  will 
now  have  to  figure  out  which. 

We  are  thus  ready,  when  the  next  sentence  Is  seen,  to  try  to 
find  answers  In  story  (9)  that  we  don't  care  about  In  story  (10). 
Furthermore,  when  "they  had  tea"  Is  read  and  $R0MANCE  becomes 
more  likely,  we  must  do  still  more  processing.  Recall  that  we 
originally  started  this  discussion  with  an  attempt  at  deciding 
the  Issue  of  when  to  track  a character's  goals.  Clearly  John's 
goals  are  more  Interesting  than  Sam's.  This  Is  because,  as  we 
have  said,  RCMANCE  Is  Interesting.  Visiting  obviously  Is  much 
less  intereslng  In  a neutral  context. 

Tracking  John's  goals  Is  done  because  they  are  easily 
dlscernable  from  the  script  he  Is  In  and  the  script  he  Is  in  is 
marked  as  interesting.  Thus  when  his  script  gets  fouled  up  we 
feel  for  him  In  a way  that  we  do  not  wi>en  Sam's  script  fouls  up. 
The  reason  Is  simple:  we  were  more  interested  In  John. 

Of  course,  much  of  what  T have  said  here  Is  quite 
speculative.  But,  If  true,  the  ramifications  for  how  we  process 
language  (on  a computer  and  off)  are  tremendous.  Since  the  crux 
of  the  matter  Is  what  Is  Interesting  and  how  those  Interest 
valties  are  computed  we  will  continue  that  discussion  In  the  next 
sectli'n.  Tlie  question  of  l»ow  Interest  values  alter  our  concepts 
of  parsing  will  be  fiirlher  discussed  In  Schank  and  Blrnbaun 


(1978) 


6>  Coal'Based  Stories 


PAM  is  a program  that  understands  goal  based  stories 


Wllensky  (1978)  cites  many  examples  of  stories  his  program  can 


handle.  These  stories  tend  to  have  a form  that  includes  a main 


character  %rho  has  a goal,  a problem  in  his  attainment  of  that 


goal,  (based  on  goal  conflicts,  or  competition  with  other 


people),  and  the  solution  of  that  problem 


As  long  as  stories  arc  entirely  goal  oriented,  Vilensky's 
program  appears  to  be  a major  achievement  In  story  understanding 


But,  the  question  of  when  goal  based  inferences  are 


programs 


appropriate  Is  a serious  Isf.iie.  Vilensky's  theory  shares  many  of 


the  virtues  and  defects  of  Rieger's  theory 


Both 


theory  and  a program  that  demonstrate  how  an  Important  class  of 


Inferences  can  facilitate  understanding.  But  both  somehow 


believe  that  their  class  of  inferences  ought  to  be  made  all  the 


time.  The  question  of  the  truth  of  that  assertion  still  remains 


although  It  Is  certainly  more  acceptable  in  Vilensky's  case  than 
In  Rieger's  since  Vilensky's  inferences  are  far  less  random  and 


are  structured  In  a good  way.  Still  uncontrolled  Inferences  can 


lead  to  very  slow  processors 


Ilop4*fn1Iy,  the  Ideas  presented  here  with  respect  to  Interest 


should  help  to  control  the  proliferation  of  inference  problem 


To  see  what  I have  In  mind  consider  the  following  two  PAM-llke 


stories 
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(11)  John  wanted  to  watch  the  football  game*  He 
started  to  turn  on  the  TV  when  Mary  announced  she 
wanted  to  watch  the  ballet.  Mary  left  the  house  crying 
and  promised  never  to  return.  When  she  did  come  back 
John  had  bought  her  roses.  They  kissed  and  made  up. 

It  turned  out  the  electricity  had  gone  out  everywhere. 

They  laughed. 

(12)  John  wanted  to  commit  a mass  murder  with  his 
shotgun.  He  started  to  load  It  when  Mary  announced 
that  she  wanted  to  go  deer  hunting.  Mary  left  the 
house  crying  and  promised  never  to  return.  When  she 
did  come  back  John  had  bought  her  a machine  gun.  They 
kissed  and  made  up.  It  turned  out  that  the  Invasion 
had  started  and  there  was  no  one  around  to  kill.  They 
laughed . 

As  far  as  I can  tell,  the  processing  for  these  two  stories 
by  PAM  would  be  virtually  identical.  They  are  both  stories  that 
include  a goal  conflict  based  on  limited  resources  and  a 
resolution  of  that  conflict.  Yet,  these  stories  seem  different 
In  an  Important  way.  The  goals  are  of  such  a different  character 
In  (12)  than  they  arc  In  (11),  that  It  Is  hard  to  believe  that  an 
understander  would  treat  them  identically.  Mass  murders  are 
simply  more  Interesting  than  watching  television.  Invasions  are 
more  interesting  than  power  failures. 


To  see  my  point  here,  it  is  necessary  to  imagine  these 
stories  within  the  context  of  larger  situations  and  explanations 
of  those  situations.  The  point  here  Is  not  to  criticize 
Wliensky.  For  contrived  materials  such  as  (11)  and  (12),  the 
processing  might  he  a great  deal  the  same  in  either  case.  But, 
within  a larger  context,  we  would  want  to  seriously  track  the 
consequences  of  the  Invasion  and  the  mass  miirder.  The  goals  and 
plans  there  are  simply  a lot  more  Important  to  us  than  are  the 
ones  expressed  In  (11). 


So,  Just  as  parsing  considerations  can  be  controlled  by 


Interest  values  such  that  not  everything  has  strict  attention 


paid  to  it,  the  sane  is  the  case  with  inferences*  We  should  only 


■ake  inferences  to  the  degree  that  ve  find  sonething  interesting 


When  Iteas  of  competing  Interest  are  around,  we  would  choose  the 


more  Interesting  to  Infer  (i*e.  think)  about*  This  brings  to 


mind  a point  Wilks  (1973)  used  to  make  about  parsing*  His 


preference  semantics  "preferred"  one  sense  over  another  when  It 


had  the  choice*  No  meaning  was  ever  rejected,  but  in  a choice 


situation  one  was  preferred  for  reasons  having  to  do  %rlth  the 


context  of  the  rest  of  the  sentence*  A similar  phenomenon  occurs 


here*  In  the  absence  of  anything  else  to  do,  we  Infer  on  what  tie 


have*  But,  we  prefer  to  infer  about  Interesting  things*  So  the 


same  item  (e*g*  a power  failure)  that  can  get  us  thinking  about 


how  it  affects  the  lives  of  those  hit  by  it,  will  be  ignored  in 


the  presence  of  an  Invasion*  Thus,  Interests  can  be  overriden  by 


other  interests*  Overriding  Interests  then,  serve  to  override 


Inferences,  which  serves  to  focus  attention  and  speed  processing 


avoiding  useless  search 


In  section  3 we  sketched  out  some  general  categories  of 


Here,  we  shall  attempt  to  get  more  specific 


Interest  types 


about  tAtat  Is  likely  to  be  Interesting  and  %ihat  such  an 


assessment  of  Interestingness  means 


a-Hormnllty  of  States:  The  simplest  and  most  obvious  observation 


to  make  Is  that  something  Is  Interesting  In  direct  proportion  to 


Its  abnormality*  Abnormitllty  mnrks  something  as  being 


Interesting  at  all  levels  of  understanding 


John  has  a %ihlte  house"  Is  less  interesting  than  "John  has  a red 


house  with  pink  polka  dots 


Two  questions  are  of  Interest  here 


1-  how  do  we  know  this,  l«e«  how  Is  this  Information  stored  and 


retrieved?  2-  what  effect  does  this  Information  have  on  actual 


processing? 


1*  The  answer  to  the  first  question  depends  on  our  having  a 


standard  normality  frame  available  to  us  during  processing.  Such 


a normality  frame  tiould  have  to  work  as  follow:  Normal  behavior 


of  people  would  be  contained  under  frames  (this  Is  Minsky's 


(1975)  sense  of  the  term)  organised  around  various  aspects  of 


their  lives.  Thus,  there  would  be  a NORMAL  POSSESSIONS  frame  for 


example,  that  would  be  used  as  the  basis  for  Inferring  the 


prototypical  man's  possessions.  People  are  capable  of  answering 


questions  about  the  prototypical  man's  posesslons  (e.g.  does  the 


average  American  own  an  elephant?,  does  the  average  American  own 


a TV  set?),  so  It  seems  obvious  that  such  Information  must  be 


available.  Furthermore,  It  Is  absolutely  necessary  to  have  such 


Information  in  order  to  understand  a great  many  English  words  In 


Hum,  words  such  as  'ambitious 


aggressive',  'hippie 


obsequious'  etc.  cannot  be  understood 


except  by  comparison  with  a norm  (this  Issue  Is  discussed  In 


greater  detail  In  Schank  and  Lebowltz  (1978)  and  In  Carbonell 


(1978)) 


linving  this  norn.’illty  I r;im€>  for  imoiiiohh litns  ;ivnl1/tb1r  nllows 


us  to  look  up  the  normotlvc  color  of  houses  that  people  live  In 


Nov  by  this  I do  not  nean  that  there  Is  only  one  normative  color 


Whatever  is  common  vould  be  listed  there.  Also,  the  existence  of 


house  on  the  possessions  frame  would  make  such  a possession 


nonaatlve,  causing  us  not  to  focus  on  it*  The  opposite  would  be 


the  case  for  example  In  'John  has  a purple  helicopter'  where 


neither  the  color  nor  the  possession  are  normative.  2.  When 


something  has  been  determined  to  be  non-normative  ('abnormal 


seems  a bit  loaded).  It  affects  processing  by  causing  us  to  focus 


on  the  non-normative  (or  interesting)  Item.  Basically  there  are 


two  kinds  of  such  focussing  of  Interests 


When  an  Item  Is  deemed 


to  be  of  interest,  the  actual  practical  effect  of  such  a Judgment 


Is  to  cause  the  Inference  process  to  take  a particular  path.  In 


general  there  are  two  kinds  of  paths  available,  forward  and 


backward  (see  Schank  and  Rieger  (1974)).  Such  paths  are 


directions  along  a causal  chain  of  events  (see  Schank  (1973)) 


That  Is,  either  we  will  want  to  know  the  reasons  for  a given 


event  or  we  will  want  to  know  the  possible  consequences  of  a 


Such  different  Interests  will  be  marked  for 


event 


deviations  from  norms  (as  well  as  from  other  things).  So,  weird 


colors  for  houses  are  backward  Interesting  (that  is,  %<hy  would 


someone  do  such  a thing?)  rather  than  forward  Interesting  (not  a 


lot  follow  from  such  a state  of  affairs,  although  some  things  do 


so  It  Is  to  some  degree  forward  Interesting).  The  processing 


consequences  Chen  have  to  do  with  how  many  formward  and  backward 


Inferences  will  be  made.  This  depends  on  other  things  than  Just 
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the  sentence  Itself  of  course.  The  surrounding  context  must  be 
Integrated  Into  a connected  causal  chain  in  any  story 
understanding  task  In  any  case  (Schank  (1975)),  so  the  Interest 
values  serve  primarily  to  give  hints  of  where  to  look  first  in 
this  case. 

b-Normallty  of  Actions:  Actions  have  normality  levels  also.  For 
example,  if  we  hear  that  'John  entered  the  room  by  climbing  in 
the  window',  this  is  more  Interesting  than  more  usual  entrances. 
'Going  down  the  chimney'  is  even  more  interesting  still.  To 
account  for  this  we  need  to  have  normality  descriptions  at  nearly 
every  level.  We  need  to  know  how  people  normally  enter  rooms, 
how  they  buy  meat,  how  they  get  promoted  and  so  on.  This  Implies 
that  any  memory  model  must  contain,  in  addition  to  Its  store  of 
Information  about  scripts,  plans,  goals  and  themes  (Schank  and 
Abelson  (1977)),  normality  information  with  respect  to  each  one 
of  the  specific  knowledge  structures  that  arc  known  about.  This 
in  many  cases  Is  no  more  than  the  normal  default  values  for  a 
script  for  example.  A script  Is  constructed  around  such 
normality  Information  and  all  we  are  saying  here  Is  that  that 
Information  must  be  present  for  all  types  of  knowledge  structures 
and  that  that  Information  Is  of  great  use  In  computing  Interest 
values.  Its  use  Is  very  simple.  According  to  Rieger  and 
Wllensky  we  need  to  be  finding  explanations  all  the  time  for  the 
new  Information  we  receive.  What  I have  been  saying  here  amounts 
to  this:  we  do  not  bother  to  find  explanations  for  uninteresting 
events  or  states.  Further,  some  things  are  Interesting  to  the 
extent  that  we  need  to  find  such  backward  explanations,  and  some 
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are  interesting  to  the  extent  that  they  cause  us  to  looV  for 
expected  consequences  which  nay  be  of  use  In  finding  explanations 
for  future  Inputs* 


c-Concepts:  Some  concepts  are  Interesting  because  of  their 
relationship  to  the  metrics  proposed  In  section  3.  By  those 
rules  concepts  such  as  'Invade',  'bomb',  'explode',  'seduce', 
'murder',  and  so  on  are  Interesting.  To  answer  the  two  questions 
posed  above,  this  Information  is  stored  In  the  dictionary  under 
the  concepts  themselves  and  so  it  Is  In  this  case  easily  found. 
Its  use  is  also  found  In  the  dictionary.  So  Invade  Is  both 
Interesting  forward  and  backward  as  are  all  the  other  words 
listed  here.  Ihat  means  that  we  would  follow  stories  involving 
such  concepts  more  closely,  trying  to  connect  together  other 
events  we  know  about  to  the  event  that  involves  these  concepts. 
I should  point  out  that  interest  values  are  relative  of  course, 
so  the  presence  of  all  these  concepts  in  one  story  would  cause 
those  of  lesser  Interest  to  be  Ignored  and  treated  as  If  they 
were  uninteresting.  It  should  be  remembered  that  what  is  at 
Issue  here  Is  what  to  pay  attention  to  and  what  to  Ignore,  and 
that  this  can  only  be  a relatively  decidable  Issue.  In  a story 
describing  the  various  methods  of  growing  corn,  a taller  than 
normal  cornstalk  may  be  the  most  exciting  thing  around. 


d-Scripts:  Certain  scripts  are  interesting  and  certain  ones  are 
not,  just  the  way  certain  concepts  are  interesting  and  certain 
concepts  are  not.  Thus,  associated  with  a given  script  will  be 
an  Interest  value.  For  example,  $CAR-STARTING,or  $SECRETARY,  are 
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not  likely  to  be  very  Interesting,  vhereas,  $BOMBING,  or 
$COURTINC  are  more  Interesting*  Here  again  these  things  can  be 
listed  In  the  memory  under  the  script  Itself.  The  question  of 
the  effect  of  this  Interest  value  is  somewhat  more  complex.  When 
we  say  a script  Is  Interesting  we  can  mean  a number  of  different 
things  by  It.  One  thing  we  can  mean  Is  essentially  the  same 
thing  that  we  have  been  discussing  so  far.  That  Is,  the 
consequences  of  that  script  taking  place  or  the  reasons  for  It 
taking  place  should  be  tracked  and  connected  In  a chain  of 
events.  Such  an  approach  says  that  In  one  sense  a script  Is 
viewed  as  an  event  In  Itself  Just  like  any  other  event.  This 
view  is  correct  but  It  Is  only  one  side  of  the  question.  Scripts 
are  also  structures  inside  which  other  events  can  fit.  Because 
of  this  they  can  tell  us  things  of  relevance  to  the  question  of 
controlling  inference  by  interests.  In  particular,  they  tell  us 
whether  to  pay  attention  at  all  to  events  that  fit  Inside  the 
script  Itself.  Sometimes  we  hear  stories  that  relate  all  the 
events  Inside  a script  that  we  have  deemed  uninteresting  (many  of 
the  initial  stories  that  SAM  processed  would  fit  In  here  for 
example  as  would  a great  deal  of  everyday  human  conversation.) 
Since  the  script  Itself  is  uninteresting.  It  follows  that  an 
understander  need  not  track  with  any  great  seriousness  the  events 
that  comprise  the  script.  That  Is,  an  understander  In  that 
situation  need  only  decide  th.nt  what  he  has  heard  belongs  to  the 
script.  He  need  not  worry  nhoiit  the  potential  Inferences  from  an 
event  onei*  that  has  been  decided*  The  only  exception  to  this  Is 
If  the  new  event  d«ies  not  match  the  normal  flow  of  events  In  the 
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script  or  If  the  new  event  Is  Itself  deemed  to  be  Interesting  on 
grounds  found  Independent  of  Its  piece  In  the  script  (there  was 
poison  in  the  hamburger  for  example).  Although  we  did  not 
realize  It  at  the  time,  the  question  answering  rules  discovered 
by  lehnert  (1977)  that  were  shown  to  be  often  Independent  of  the 
story  Itself  ran  be  used  to  argue  that  one  need  hardly  pay 
attention  to  a normal  script  story  at  all  In  order  to  understand 
It.  That  Is,  if  It  is  not  Interesting  to  read  a story  one  need 
hardly  pay  attention  to  It  and  still  not  pay  any  penalty  in 
question  answering  ability  or  understanding  in  general. 

e-Plans,  Goals  etc:  When  we  find  that  a script  is  of  interest, 
then  we  know  that  It  needs  to  be  fit  into  a chain  that  connects 
It  to  other  events.  Such  chains  imply  plans  that  connect  to  the 
script  and  goals  that  connect  to  the  plans.  Thus,  one  way  that  a 
plan  can  be  determined  to  be  Interesting  Is  if  it  has  an 
Interesting  script  or  planbox  (see  Schank  and  Abelson  (1977)) 
being  used  for  carrying  it  out.  A plan  is  rarely  Itself 
interesting,  but  it  can  be  determined  to  be  interesting  by 
looking  at  %jhat  it  is  connected  to.  A D-CONTROL  for  example  can 
be  Interesting  if  an  interesting  planbox  (e.g.  THREATEN  or 
OVERPOWER)  Is  being  used;  or  if  the  object  desired  is  of 
Interest  (e.g.  the  Kohlnoor  diamond);  or  If  the  goal  dominating 
the  plan  is  of  interest  (e.g.  conquer  Babylon,  or  become  richest 
man  in  tiu'  world). 
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The  consequences  of  determining  that  a plan  Is  of  Interest 
are  perhaps  the  greatest  of  all.  When  we  determine  that  a plan 
is  of  interest,  we  can  begin  to  intelligently  follow  what  is 
going  on  In  a story.  We  can  track  things  that  are  related  to 
that  plan  and  Ignore  things  that  are  not.  Essentially  then,  all 
of  this  Interest  tracking  is  leading  up  to  the  time  that  we  can 
safely  look  for  items  of  Interest  in  a story,  knowing  what  to  pay 
attention  to  and  wltat  to  ignore.  That  is,  we  read  looking  for 
answers  to  'did  the  murderer  escape?',  'who  fired  the  shot?', 
'how  did  Nancy  get  pregnant?',  'What  did  the  doctor  say?'. 
Understanding  then.  Is  very  much  .c  process  of  tracking  interests 
and  knowing  when  to  bring  the  full  power  of  our  Inferential 
apparatus  to  bear  upon  the  situation  at  hand,  and,  more 
Importantly,  knowing  when  not  to. 

f -Comb in at ions  of  Concepts:  It  seems  obvious  that  not  only  are 
individual  concepts  Inherently  interesting  or  not,  but  also 
combinations  of  uninteresting  concepts  can  be  themselves 
Interesting.  For  example,  'eating'  Is  not  Interesting,  and  'Mr. 
Clean'  Is  not  Interesting,  but  'eating  Mr.  Clean'  Is.  How  to 
explain  this  Is  the  topic  of  the  next  section. 

P.  Concept  Combinations 

The  problem  of  combining  concepts  relates  back  to  the 
Muhammed  All  problem.  Neither  hitting  nor  All  are  themsleves 
Interesting  but  their  combination  Is.  Here,  interestingness  has 
a very  Important  consequence.  Recall  that  the  original  problem 
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was 

that  there  were  a 

great  many  Infert'iiccs  that 

could 

he  made 

but 

that 

1 1 somi'how 

did  n«>t  seem 

that  they  all 

were  being  made. 

Did 

John ' s 

hand  hurt? 

Was  he  angry 

at  All?  Did 

he  have 

to  move 

his 

hand? 

Any  or 

all  of  the 

possible  Inferences 

could  be 

correct,  but  somehow  the  question  of  All's  response  seems  most 
significant*  The  question  before  us  Is  'why  Is  this  so'?  The 
answer  to  this  problem  can  be  found  by  consulting  a 
discrimination  tree  for  the  combination  of  concepts  Involved. 
What  this  discrimination  tree  does  for  us  Is  tell  us  what  Is 
Interesting  and  therefore  what  inferences  should  be  followed. 
Let  us  consider  the  one  for  PROPEL  since  this  Is  the  action  that 
underlies  'hit': 


PROPEL  (discriminations  on  the  object  of  PROPEL) 

first  discrimination:  dense  or  not  dense 
choose  dense 

second  discrimination:  capable  of  severely  harming  actor 

of  PROPEL  or  not 
choose  capable  of  harming 
third  discrimination:  animate  or  inanimate 
choose  animate 

END  OF  BRANCH:  Policeman;  M.  All;  Murderer;  Mafioso 
RESULTS:  Interest  value  very  high  (10) 

INFERENCES:  forward  on  harmful  effects  on  actor 

effected  by  object  In  new  event  tried  first 

choose  Inanimate  container  (Includes  vehicles) 

END  OF  BRANCH:  car;  building;  train 
RESULTS:  Interest  value  very  high  (9) 

INFERENCES:  forward  on  harmful  state  of  actor  resulting 

from  PROPEL  tried  first,  harmful  state  of 
people  contained  in  object  tried  second 

choose  not  capable  of  severely  harming  actor 

fourth  discrimination:  depends  on  size  of  object  and  speed  of  PROPEL 
END  OF  BRANCH:  wall;  door;  baseball 
RFSULTS:  Height  of  Interest  directly  proportional 
to  speed  and  size  combination 
INFERENCES:  forward  on  harmful  state  of  actor  resulting 
fnvn  PROPEL  tried  first 

choose  dense 

fifth  discrimination:  personal  effect  or  not 
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choose  personal  effect 

sixth  discrimination:  friend  or  enemy 

choose  friend 

END  OF  BRANCH:  list  of  positively  related  people 
RESULTS:  Height  of  Interest  directly  proportional 

to  positive  relatedness  of  person  In  object  slot 
INFERENCES:  backward  on  reasons  for  actions,  forward  on 
harmful  emotional  and  relationship  effects, 
then  on  physical  effects. 

choose  enemy 

END  OF  BRANCH:  list  of  negatively  related  people 
RESULTS:  Height  of  Interest  directly  proportional 

to  negative  relatedness  of  person  In  object 
slot 

INFERENCES:  forward  on  physical  effects  and  possible 
reprisal  s 


choose  no  personal  effect 

seventh  discrimination:  potentially  harmful  to  actor 

choose  not  harmful  * 

END  OF  BRANCH:  children,  small  animals  etc* 

RESULTS:  Height  of  Interest  dependent  on  value  of  objefct, 
children  high,  armadillos  low 
INFERENCES:  backward  on  reasons  for  action,  forward  on 

possible  negative  physical  effects  on  object 
(but  the  lower  the  Interest  level  the  less 
this  Is  done,  thus,  ants  and  pencils  get 
little  In  the  way  of  Inferences. 


choose  possibly  harmful 

END  OF  BRANCH:  dogs,  bears  etc. 

RESULTS:  Height  of  Interest  directly  proportional 
to  potential  harmfulness  of  object 
INFERENCES:  backward  on  previous  events  Involving 
potential  hazard  to  actor 


The  most  Important  function  of  this  tree  then  Is  to  focus 
the  inference  process.  Inferences  are  made  because  there  Is 
reason  to  believe  that  they  will  lead  to  Interesting  events.  The 
decision  to  make  an  inference  Is  precoded  In  this  tree.  Where 
this  tree  comes  friMit  originally  Is  an  open  question,  but 
something  like  Its  compiled  form  must  be  available  to  an 
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To  give  a feel  for  what  other  trees  of  this  t]rpe  must  look 
like,  below  Is  the  INGEST  tree  given  In  a simpler  form  Just 
listing  a numerical  Interest  rating.  Any  actual  tree  would  have 
to  look  like  the  one  above  however. 


INGEST 

NOT  POSSIBLE 

NOT  FOOD 

DEADLY 

NOT  FOOD 

NOT  FOOD 

NOT  FOOD 

DEADLY 

OTHER  FUNC 

NOT  DEADLY 

NOT  FUN 

NOT  FUN 

FUN 

BAD  taste 

NEUTRAL 

air  cond 
blackboard 

arsenic 

Mr.  Clean 

coke 

chalk 

dime 

car 

Comet 

dope 

marbles 

INT-  10 

INT-9 

INT-8 

liquor 

INT-6 

INT-  5 

INT-7 

FOOD 

FOOD 

FOOD 

FOOD 

EXPENSIVE 

EXOTIC 

INEXPENSIVE 

INEXP 

FANCY 

caviar 

pol 

GOOD 

EH 

INT-4 

taro  root 

steak 

lettuce 

INT-3 

lobster 

INT-2 

hot  dog 
INT-1 

The  presence  of  these  discrimination  trees  Implies  that 
there  Is  a set  of  values  available  for  any  given  object  (we 
Ignore  for  the  time  being  how  these  values  become  available) . 
Thus,  for  an  item  such  as  chalk  for  example,  we  might  find: 


chalk  - general  IHTERFST  value  (1) 

INCEST  (6) 

PROPEI.  (2) 

CRASP  (I) 

PTRANS  (0) 

ATRANS  value  (0) 

These  values  mean  that  In  general  chalk  will  not  be  paid 
attention  to.  Some  Interest  would  be  paid  to  chalk  being  eaten 
however.  Zero  values  indicate  that  something  will  almost  never 


even  be  mentioned*  If  It  Is  one  might  wonder  why 


9>Vhat  to  Pay  Attention  to 

To  see  how  to  actually  make  use  of  what  we  have  said  so  far, 
let  us  consider  a few  situations.  Assuming  John  Is  someone  we 
both  know  and  T say  "John  is  iinsrriipiilnus"  it  is  reasonable  to 
respond  "Oh,  what  did  he  do?".  It  is  reasonable  to  respond  this 
way  because  unscrupulousness  has  a backward  Interest  value  of  say 
3 and  the  personal  relatedness  operator  ups  that  to  say  5.  A 
backward  Interest  value  of  5 would  be  the  condition  necessary  to 
cause  a conversational  rule  of  the  type  'ask  about  previous  event 
when  a Judgemental  state  has  been  expressed'  to  be  fired  off. 

Now  consider  what  would  happen  If  I said  "John  Is  a 
murderer".  We  would  expect  an  response  of  something  like  "What? 
What  are  you  talking  about?  What  did  he  do?".  We  are  still 
backward  Interested  here,  only  the  interest  is  much  higher.  (We 
can  express  that  by  saying  that  murder  is  TNT  (10).)  But  murderer 
also  has  a extremely  high  forward  Interest  value.  This  might  be 
mitigated  to  some  extent  by  the  personal  relatedness  operator, 
but  In  general  we  are  concerned  that  this  murderer  might  threaten 
us  as  well.  (To  give  a more  common  example  of  this.  Imagine 
being  informed  that  your  cleaning  lady  Is  a thief.) 

So  vdion  aometliing  has  a high  forward  and  backward  interest 
value,  we  In  general  want  to  know  the  details  of  past  events  and 
the  prognosis  for  future  ones.  In  story  understanding,  these  are 
expressed  as  inferences  up  and  down  the  causal  chain.  In 


conversation  they  cause  us  to  attempt  to  find  out  past  details 
and  VK>rry  about  future  events. 

Now  this  Is  all  not  a simple  process.  It  Is  mitigated  In 
real  life  situations  by  a number  of  personal  factors.  For 
example  If  you  have  a positive  affinity  for  John  it  Is  also 
necessary  to  infer  forward  about  how  he  will  escape  the  police 
and  how  you  might  help.  In  a story  these  Inferences  would  be 
made  as  well  but  they  would  be  secondary  since  the  forward 
Interest  values  for  murder  are  lower  than  are  the  backward  ones. 

The  methods  I have  described  solve  the  Muhammed  All  problem: 

John  was  walking  down  the  street.  He  saw  Huhammed  All. 

He  went  over  and  punched  him  In  the  nose. 

Main  Inference:  Was  John  hurt? 

From  the  discrimination  tree  for  PROPEL  we  get  a forward  interest 
value  that  Is  high  that  directs  us  to  look  at  the  effect  of  the 
event  on  the  actor.  This  causes  us  to  infer  what  All  might  do  to 
John  in  retaliation  wiilch  allows  us  to  speculate  on  John's  new 
physical  state. 

In  addition  to  the  combination  effects  that  you  get  when  two 
uninteresting  concepts  are  present  In  the  same  events  we  get 
combination  effects  when  uninteresting  scripts  are  Interwoven. 
Thus,  for  example,  undressing  Is  not  very  Interesting  (say  2)  and 
restaurants  are  not  Interesting  (say  I),  but,  undressing  In  a 
restaurant  Is  very  Interesting  (say  6).  Why?  First,  we  know 
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that  Interference/resoUit  ton  paths  In  a script  are  Interesting 
(see  Culllngford  (1977)).  Obviously  there  are  various  kinds  of 
Interferences.  There  are  the  standard  ones  Involving  lack  of 
money  or  bad  food  or  a restaurant  that  la  out  of  food.  There  arc 
also  Intrinsically  Interesting  ones  (that  Is,  ones  that  are 
Interesting  i/lthout  being  embedded  In  another  script)  such  as  a 
fire  or  an  earthquake.  But  there  Is  also  a class  of  combinatory 
Interests.  Undressing  In  restaurant  is  interesting  because 
undressing  Is  PRIVATE  behavior  that  Is  being  perfotmed  In  a 
public  place.  This  Implies  that  all  behaviour  is  marked  for  Its 
public  or  private  nature  and  that  very  private  behavior  In  very 
public  places  Is  especially  Interesting.  This  we  might  mark 
privateness  for  the  following:  bathroom  10;  sex  ■ 9;  sleeping 
7,  ...talking  0 . Here  then,  we  would  have  such  an  interesting 
combination.  Inappropriate  behavior  Is  Interesting  both  forward 
and  backwards,  but  It  Is  mostly  a forward  process  (then  what 
happened?) . 

Public  behaviour  in  a private  place  Is  also  inappropriate 
but  Is  less  Interesting.  For  example,  asking  for  a menu  at  home 
or  talking  to  your  wife  as  you  do  to  a student  Is  Inappropriate 
and  mildly  forward  interesting.  In  addition,  not  conforming  to 
role  stereotypes  In  a situation  Is  Interesting  as  Is  deviating 
from  any  norm  as  we  have  stated  before.  (This  of  course  brings 
us  full  circle  since  wealth,  murder,  ambition,  aggressions  are 
Interesting  and  defined  In  terms  of  the  norm  In  the  first  place. 


i 


f 


j 

I 

I 

4 


i 


t 

i 


Page  42 


At  a higher  level  of  knowledge  structures  certain  goals  are 
themselves  Interesting*  For  example,  A (Achieve)  - POSSESS  Is 
Interesting  while  A - RESPECT  Is  not.  Similarly,  A - LOVED  ONES 
Is  not  Interesting  and  > - SUCCESS  is. 

Certain  plans  are  Interesting  If  they  use  planboxes  that  are 
at  the  high  end  of  the  scale  (see  Schank  and  Abelsop  (1977)). 
Thus  OVERPOWER  is  maximally  Interesting  while  EXPRESS  PESIRE  Is 
not.  Weird  ways  of  achieving  a goal  are  also  Interesting  as  Is 
not  using  a known  planbox  or  violating  a planbox's  preconditions. 

10.  Conclusion 

There  Is  really  very  little  to  conclude  at  this  point 
because  this  paper  has  been  highly  speculative.  We  can  simply 
reiterate  that  It  Is  crucial  for  us  to  understand  how  Inferences 
are  controlled.  Perhaps  Interestingness  and  partial  processing 
are  part  of  the  solution.  In  any  event  these  ideas  seem  worth 
exploring  both  experimentally  and  computationally. 
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